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METHOD FOR TRACKING AT LEAST ONE OBJECT IN A SCENE 
FIELD OF THE INVENTION 

The present invention relates to a method for tracking at 
least one object in a scene. 

5 

BACKGROUND INFORMATION 

Video sensors based on modern computer architectures are 
able to detect objects moving in a directional manner in 

10 image sequences of stationary cameras. The monitoring 

normally tracks the beginning point at which predefined 
threshold values with respect to segment distance or size 
are exceeded. Such condition is detected by changes in the 
image signal caused by the movement of objects such as 

15 persons, for example, whereupon a corresponding signaling or 
image recording takes place. In this manner, the objective 
of raising an alarm concerning an unauthorized entry may be 
realized - 

20 SUMMARY 

The method according to the present invention for tracking 
at least one object in a scene has the advantage that it 
generates a signaling as a function of the dwell time of an 
25 object at a particular location. In this way, an atypical 
behavior pattern in a monitored scene in which moving 
objects are usually present is detected immediately. This 
may result in a more rapid alarm triggering, and in better 
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monitoring. In the process, objects that have made the 
transition from movement to standstill are able to be 
detected and result in a signal. 



5 It is advantageous that in accordance with the present 

invention, the signaling, which is generated as a function 
of a counter reading, results in an alarm. This means that 
an alarm is generated when an object remains stationary for 
a predefined period of time, the predefined time 
10 constituting a threshold value for the counter reading . 

The movement of a particular object is described by a list 
or a matrix: in one line, the image coordinates of the 
object in the x-direction are stored at different instants 

15 for the individual images of an image sequence and, in a 

second line, the corresponding y-values are stored, that is, 
the vertical values of the object at these corresponding 
instants. The x- value and the y-value at a predefined time 
instant represent a motion vector, i.e., in the movement 

20 direction of an object. If this motion vector is zero, a 

standstill is detected and the counter incremented. The list 
may be dynamically managed or, if a predefined number of 
list locations has been processed, it is possible that 
cumulative values are carried over into a new list for this 

25 object. This list representation makes it possible to 

monitor, and thereby track, several objects simultaneously. 
This is then managed with the aid of a processor of the 
video monitoring system and administered in the associated 
memory. A camera, which generates the image sequence, acts 

30 as imaging element. The images may be produced at relatively 
long intervals of half a second, for instance, so as to be 
able to detect the corresponding motions in a meaningful 
manner. Such motion vectors in a list may also be generated 
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between images that do not follow each other immediately, 
for instance when the movements are very slow, which allows 
high resolution of the motion. This may be done dynamically, 
i.e., if no movement is detected, a counter may 
5 simultaneously be started while the comparison continues up 
to a certain number of image sequences, above which a 
standstill is then conclusively detected, and the counter 
reading ultimately becomes relevant. 

10 The list may then be newly initialized as soon as movement 

begins anew. If values for the object able to be detected by 
an object -detect ion method are already available from a 

previous list, these may be carried over into the new list. 
This also makes it possible to analyze an entire movement 
15 sequence, which method is very efficient with respect to the 
memory resources . 

Furthermore, it is advantageous that a reference image is 
generated so as to recognize an object in a simple manner. 

2 0 To generate a time and object template, a so-called 

reference image must be obtained that, if possible, contains 
only the background of the scene, without tracked objects. 
This reference image is generally obtained when no object is 
present, for example^ from the next -to- last image. This 
25 image may then be adopted as reference. This method is 

useful, in particular, for a small number of objects which 
make only a brief appearance in the scene. However, if many 
objects are tracked over longer periods of time, a reference 
image is generated in such a way that, after having 

3 0 determined the object positions in the instantaneous image, 

the reference image is carried over into the remaining area 
from the next-to-last image. This is referred to as local 
adaptation of the reference image . 
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The method according to the present invention may be used in 
video monitoring, in particular, where at least one image 
generator, a processor, a memory and also output means, by 
which a signaling, such as an alarm, may then be 
5 implemented, are provided. However, the signaling may also 
be utilized as a signal for other systems. This video 
monitoring may be used to monitor a parking facility, for 
example . 

10 BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram of the video monitoring system 
according to the present invention. 

15 Figure 2 is a flow chart of the method according to the 
present invention . 

Figure 3 is a first example of video monitoring according to 
the present invention. 

20 

Figure 4 is a second example of video monitoring according 
to the present invention. 

Figure 5 is a third example of video monitoring according to 
25 the present invention. 

DETAILED DESCRIPTION 

According to the present invention, it is possible to fully 
30 track objects across a scene, i.e., a monitored area. An 
object entering the scene is detected very quickly as a 
directional ly moving object and monitored in the scene until 
the object leaves the scene again, such monitoring also 
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being known as tracking. This is shown in Figure 3. At 
location 13, a person enters the scene monitored by an image 
detector, that is, a video sensor, for example, or some 
other camera, such as a heat image camera. Since the 
5 evaluation of the video monitoring detects movement only, 

the object is not yet detected in the first image sequence. 
Only at instant 14, after a movement has been detected, is 
this object identified. At instant 15, the moving object has 
left the monitored scene. 

10 

Figure 4 shows a second scenario. Here, too, a person enters 
the scene at instant 14 and is detected as a moving object 
at instant 14. However, the person stops moving at instant 
16 and comes to a standstill, whereupon the method according 
15 to the present invention starts a counter in order to 

monitor the dwell time. A signal may then be generated as a 
function of the dwell time. This signaling may be an alarm, 
for instance. 

2 0 Figure 5, in a third scenario, shows additional 

possibilities for a plurality of objects. An object 14 is 
detected as moving. At instant 17, a split is implemented 
here, that is, the object is split into two objects. This is 
detected by different motion vectors originating from the 
25 same object. Instant 18 shows a so-called merge, i.e., a 
merging of two objects, which may then lead to another 
split. This merge is caused by an additional object 19, 
which was detected as moving object 20. The first object 
leaves the scene at instant 21, while the second object 

3 0 makes the transition from movement to standstill at instant 

22. 

Figure 1 shows a block diagram of a video monitoring system 
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according to the present invention. An image detector, a 
monitoring camera 1 in this case, is connected to a 
processor 2 . A memory 3 is connected to processor 2 via a 
data input/output. By means of a data line, processor 2 is 
5 connected to a control 4, which is connected to a 

loudspeaker 5 on one side and to a display 6 on the other 
side - 

Only one camera 1 is indicated here by way of example. 

10 However, a plurality of cameras may be provided so as to 

monitor several scenes simultaneously and have these cameras 
operated by a processor 2. Furthermore, only one loudspeaker 
5 and one display 6, which are used to output an alarm, are 
illustrated here by way of example. However, the signaling 

15 transmitted from processor 2 to control 4 may be used as 

well. The method according to the present invention, which 
will now be elucidated on the basis of the flow chart shown 
in Figure 2, may be executed on processor 2. In method step 
7, on the basis of the motion vector and with the aid of 

20 camera 1 and processor 2, a moving object is detected^, as 
shown in Figure 3. A list or matrix is prepared for this 
purpose, in which each column, for instance, denotes a 
specific image in an image sequence, with the image 
sequences being separated by time intervals, such as one 

25 second, for example. Furthermore, the list has two lines 
defining the motion vector in a plane. This is normally 
defined by the coordinates x and y, for instance. Two lists 
illustrating this are shown below. In list 1, a motion 
vector having x- value 123 and y- value 12 is detected at 

30 instant 0. At instant 99, which corresponds to 50 seconds in 
this case, a standstill is counted that has already begun at 
instant 1, which corresponds to one second. This is a 
predefined list, that is, it allows only 100 new entries. 
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For this reason, the list is newly initialized once instant 
99 is reached, and it is continued with the second list, 
which adopts the value. As shown, values 123 and 12 are 
reentered at instant 0 and standstill 0/0 at instant 1. 
5 However, the 50 seconds are then added at instant 2, and 
counting resumes anew. 



List 1: 





Instant 


0 


1 


2 


3 


.... 99 




10 


X 


123 


1 


2 


0 


.... 0 






Y 


12 


0 


3 


0 


.... 0 






0:00 


0:01 




0:02 




0:03 


0 :50 




List 1, 


newly 


initialized : 






15 


Instant 


0 


1 


2 


3 








X 


126 


0 


0 


0 








Y 


15 


0 


0 


0 







0:00 0:03 0:51 0:52 



20 Using this list, the object is tracked in method step 8. If 
a standstill is detected in method step 9, namely by entries 
0/0 in the list, the counter is started in method step 10. 
If this is not the case, the object continues to be tracked 
by the list. However, if the counter was started in method 

25 step 10, it is ascertained in method step 11 whether a 

predefined threshold is reached. Reaching this threshold 
causes a signaling in method step 12. In this case, the 
signaling may be implemented by means of loudspeaker 5 or 
display 6, that is, by outputting an alarm, for instance. 

30 However, if this threshold is not reached and the object 
moves again, it is returned to method step 8 and the 
tracking of the object resumes. 
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